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LOWER RESOLUTION HDTV RECEIVERS 

This invention is directed to high definition television 
(HDTV) receivers and more particularly to television receivers 
\ 5 which are responsive to HDTV signals but are of lower cost and 
are of quality commensurate with NTSC receivers. 

The systems proposed and currently being evaluated 
for the future HDTV system of the United States of America, are 
primarily digital and provide relatively high resolution images. 

1 0 Since the signals are digital and of relatively high resolution, 

receivers designed to process such signals will require significant 
amounts of state of the art hardware, including a significant 
amount of video memory (VRAM). Until the technology matures, 
which may take ten to fifteen years, this hardware will render the 
15 HDTV receivers expensive, probably so much so as to preclude 
purchase by middle class families of more than one receiver per 
home. However most middle class families are accustomed to 
having a plurality of receivers in their homes. Thus there is a 
need for a lower cost HDTV receiver in the nearer term. 

2 0 The present inventor realized that it is possible to 

provide a lower cost receiver of HDTV signals but at the sacrifice 
of some image resolution. Such receivers will still have 
advantages over NTSC receivers in that they will not suffer the 
common NTSC shortcomings such as crosscolor and crossluma, and 

2 5 being digital will be compatible with other digital apparatus such 

as home computers. 

A typical HDTV signal may represent images with 
1050 lines and 1440 pixels per line. A typical HDTV receiver may 
require, for example, four VRAMS for processing decoded signal 

3 0 and further memory to buffer several fields of compressed data. 

Considering eight bit samples, the four VRAMS will require 48.38 
Mbits of very fast memory. Alternatively if the HDTV signal is 
decoded to normal NTSC resolution of 525 lines with 9i0 pixels 
per line, only 15.29 Mbits of slower VRAM are required, or 
3 5 approximately one third of that required for the high resolution 
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image. The requirement of less memory and slower memory can 
effect a significant cost savings in a lower resolution receiver. 

The present invention is an apparatus for accepting an 
5 HDTV signal of relatively high resolution and exploiting only a 
portion of the data in the signal to produce a signal representing 
ail image of lesser resolution to effect a reduction in the hardware 
required to reproduce an image. 

10 BRIEF DESCRIPTION OF THE DRAWINGS 

FIGURE 1 is a pictorial representation of a layered 
signal useful in describing the invention. 

FIGURE 2 is a block diagram of a typical television 
receiver of the type for processing compressed digital television 
1 5 signals. 

FIGURE 3 is a block diagram of decompression 
apparatus which may be incorporated in element 14 of FIGURE 1, 
in the context of a HDTV receiver. 

FIGURES 4, 5, 7 and 8 are block diagrams of alternate 

2 0 embodiments of decompression circuitry embodying the 

invention. 

FIGURE 6 is a pictorial representation of an exemplary 
sample format provided by the interpolator 319 of FIGURE 5. 

FIGURES 8A, 8B and 8C are exemplary alternative 
25 masking functions which may be implemented in element 308 of 
FIGURE 8. 

FIGURE 9 is a block diagram of the coefficient masking 
apparatus 308 of FIGURE 8. 

FIGURE 10 is a flow chart of the operation of a portion 

3 0 of the FIGURE 7 apparatus. 

The invention will be described in terms of a 
compressed digital television signal of the form proposed by the 
Advanced Television Research Consortium (NBC, Thomson 
Consumer Electronics, North American Philips Corporation and 
3 5 SRI/DSRC), which is similar to the standard proposed by the 
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Motion Picture Experts Group (MPEG) and detailed in the 
document "International Organization for Standardization", ISO- 
IEC JT(1/SC2/WG1), Coding of Moving Pictures and Associated 
5 Audio, MPEG 90/176 Rev.2, Dec. 18, 1990. This signal is 

hierarchically layered and of the form illustrated in FIGURE 1. It 
will be appreciated that the invention is not limited to use with 
this signal, but is applicable to at least signals having similar 
formats. 

1 0 Referring to FIGURE 1, there is shown 

diagrammatically, the general form of an MPEG compressed 
television signal. The signal is arranged in successive groups of 
pictures GOPi, each of which includes compressed data from a like 
number of image frames. The groups of pictures are indicated in 

I 5 the top row of boxes designated LI. Each GOP (L2) includes a 
header followed by segments of picture data. The GOP header 
includes data related to the horizontal and vertical picture size, 
the aspect ratio, the field/frame rate, the bit rate, etc. 

The picture data (L3) corresponding to respective 

10 fields/frames includes a picture header followed by slice data 
(L4). Respective slices, GOBi, include image information for 
contiguous image areas, for example each GOB may include data 
representing 16 consecutive horizontal image lines. The picture 
header includes a field/frame number and a picture code type. 

5 Each slice (L4) includes a header identifying its location in an 
image, followed by a plurality of macroblocks of data MBi. The 
slice header may also include a group number and a quantization 
parameter. 

Macroblocks contain image representative data for 
0 portions of a slice. A typical macroblock in the MPEG format 
represents an image area covering a matrix of 16 by 16 pixels. 
The macroblock is actually comprised of 6 blocks, four of which 
convey luminance information and two of which convey 
chrominance information. Each of the four luminance blocks 
5 represent an 8 by 8 matrix of pixels or one quarter of the 16 by 
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16 matrix. Each of the chrominance blocks is an 8 by 8 matrix 
representing the entire 16 by 16 matrix of pixels. The respective 
blocks contain Discrete Cosine Transform (DCT) coefficients 
5 generated from respective matrices of pixel data. For example 
each luminance block, generated from an 8 by 8 pixel matrix, may 
contain as many as 8 times 8 or 64 DCT coefficients. One 
coefficient conveys DC or average brightness information, and 
each of the remaining coefficients convey information related to 

1 0 different image spatial frequency spectra. The coefficients are 

arranged in a particular order with the DC coefficient first and the 
remaining coefficients in order of spectral importance. Many 
images may contain little detail resulting in many of the DCT 
coefficients being zero valued. In the hierarchy of coefficients in 

1 5 respective blocks, all zero valued coefficients following the last 

non zero valued coefficient are deleted from the block data and an 
end of block code (EOB) is inserted after the last non zero valued 
coefficient. In addition zero valued coefficients occurring before 
the last non zero valued coefficient are run length coded. Hence 

20 there may be less than 64 coefficients in a block of data. 

Each macroblock MBi (L5) includes a header followed 
by motion vectors and coded coefficients. The MBi headers 
include a macroblock address, a macroblock type and a 
quantization parameter. The coded coefficients are illustrated in 

25 layer L6. Much of the data, including DCT coefficients and header 
data is variable length coded. In addition some of the data,such as 
the DC DCT coefficients and motion vectors, are DCPM coded. 

The data shown in FIGURE 1 will typically be shuffled 
to lessen the impact of block errors, and reformatted into 

3 0 transport packets of fixed numbers of bytes to facilitate 

synchronization at the receiver. In addition, the transport packets 
of data will be error encoded, with for example a Reed-Soloman 
coder, and parity check bits appended. 
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FIGURE 2 illustrates the general form of an HDTV 
receiver. Broadcast HDTV signals are received by an antenna 9 
and applied to a tuner-demodulator 10. The output of the tuner- 
5 demodulator is a digital bit stream which is applied to a forward 
error corrector and reshuffler 11. The forward error corrector and 
reshuffler 11 includes, for example a Reed-Soloman error 
corrector, for detecting and correcting data errors incurred during 
signal transmission, and apparatus for providing inverse data 

1 0 shuffling. The error corrected, reshuffled data is applied to an 

element 12 which decomposes the transmission packet format, 
placing the data in the general sequence illustrated in FIGURE 1. 
The error correction, reshuffle and depacketing functions may 
occur in a different sequence, which sequence will be the reverse 

1 5 order of the reciprocal functions performed at the transmitter. 

The reformatted data is applied to a variable length 
decoder 13 wherein the variable length encoded data is decoded, 
and any run length encoded data is decoded. The decoded data is 
applied to a decompresser 14 which transforms the compressed 

20 image data to raster pixel data and applies the pixel data to an 
image memory or VRAM. The pixel data in the VRAM is 
thereafter applied to a display device, recorder or other video 
signal utilization apparatus. 

FIGURE 3 illustrates exemplary decompression 

2 5 apparatus arranged to process video data in MPEG-like format. 

The FIGURE 3 system is similar to a wide variety of known motion 
compensated predictive video decoders and thus a detailed 
description will not be provided herein. In FIGURE 3 data 
provided by the variable length decoder 300 is applied to a 

3 0 decompression controller 302. Incorporated in the controller are 

inverse DPCM coder 306B and 306B. The controller 302, extracts 
the header data from the compressed video data, to program its 
decompression sequences. Typically the controller is a state 
machine programmed to perform particular routines subject to 
3 5 certain variables which are included in the header data. 
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The controller 302 directs coefficient data through the 
inverse DPCM coder 3 06 A wherein appropriate codewords are 
passed unaltered or decoded as required. Motion vector data is 
5 directed through the inverse DPCM coder 306B, wherein the 

vectors are decoded. The decoded motion vectors are coupled to 
the motion compensated predictor 304, and the coefficients are 
coupled to the inverse DCT apparatus or IDCT 310. The IDCT 
apparatus, responsive to blocks of coefficients generates 8 by 8 

1 0 matrices of pixel information, which is applied in predetermined 
order to an adder 312. Output data from the adder 312 
corresponds to decompressed pixel values. These values are input 
to a display memory (VRAM) 318 , from which the may be 
applied to a display device. The output values from adder 312 are 

15 also applied to a pair of buffer memories or VRAM's 314 and 316. 
The memories 314 and 316 each have sufficient capacity to store 
one image frame of pixel data. The VRAM's 314 and 316 are 
coupled to the predictor 304. The predictor 304, responsive to 
motion vectors, accesses appropriate 8 by 8 blocks of pixel data 

2 0 from the VRAM's 314, 316 or both and applies same to the adder 
312. 

In general, in an MPEG-like system data representing 
predetermined frames is intraframe encoded, and data 
representing the remaining frames is interframe encoded. The 

2 5 data representing intraframe encoded frames is generated by 

segmenting pixel values into respective 8 by 8 blocks and 
performing the DCT on the pixel data. Alternatively data 
representing interframe encoded frames is generated by 
predicting image frames from preceding frames, following frames, 

3 0 or both; determining the differences (residues) between the 

predicted and actual frames; and performing the DCT on 8 by 8 
blocks of residue data. Thus intraframe DCT coefficients represent 
image data, and interframe DCT coefficients represent frame 
difference data. No motion vectors are generated for intraframe 
3 5 encoded frames. Motion vectors, for interframe encoded frames, 
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are codewords which identify 8 by 8 blocks of pixels in frames 
from which predicted frames are generated, which blocks most 
closely match the block currently being processed in the frame 
5 currently being encoded. For a more detailed explanation of an 
MPEG-like coding/decoding process, the reader is directed to U.S. 
patent NO. 5,122,875. 

Referring again to FIGURE 3, when intraframe encoded 
frames (I) are being processed, the predictor 304 is conditioned to 
10 apply zero values to the adder 312. The inverse DCT processed 
data provided by the IDCT 310 corresponds to blocks of pixel 
values. These values are passed unaltered by the adder 312, and 
are loaded in the VRAM 318 for display, and loaded in one of the 
VRAM's 314 or 316 for use in predicting subsequent frames. 

1 5 Immediately after an I frame is decoded, an interframe encoded 

frame (P) corresponding to a frame occurring a predetermined 
number of frames after the I frame, is available from the variable 
length decoder. This P frame was, at the encoder, predicted from 
the preceding I frame. The DCT coefficients of the P frame thus 

2 0 represent residues, which when added to the pixel values of the 

decoded I frame, will generate the pixel values for the current P 
frame. On decoding this P frame, the IDCT 310 provides decoded 
residue values to the adder 312, and the predictor 304, 
responsive to the motion vectors, accesses the corresponding 

2 5 blocks of pixel values of the I frame from VRAM and applies them 

in appropriate order to the adder 312. The sums provided by the 
adder are the pixel values for this P frame. These pixel values are 
loaded into the display RAM 318, and into the one of the VRAM's 
314 or 316 that is not storing the decoded I frame pixel values. 
30 Subsequent to the decoding of the P frame, the 

encoded frames (B frames) which normally occur intermediate the 
I and P frame are provided, which frames have been interframe 
encoded and thus are decoded similarly to the P frame. However 
decoded B frame data is not stored in the VRAM"s 314 and 316, as 

3 5 decoded B frame data is not used to predict other frames. 
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FIGURE 4 illustrates a first embodiment of he 
invention. FIGURE 4 includes a portion of the relevant apparatus 
of FIGURE 3 in abbreviated form, and elements of FIGURE 4 
5 designated with the same numbers as elements in FIGURE 3 are 
similar. In FIGURE 4 a two dimensional decimator 311 has been 
interposed between the IDCT 310 and the adder 312. The 
decimator 311 includes a subsampler to eliminate, for example, 
every other row of values and every other value (pixel values or 
10 pixel residue) in the remaining rows of the pixel matrices 

provided by the IDCT, to reduce the pixel data points by a factor 
of 4. The subsampling may be arranged to eliminate vertically 
aligned pixel data or according to a quincunx format to provide 
higher effective resolution in the reduced data. The decimator 

1 5 may also include a low pass filter to preclude aliasing by the 

subsampling process. Other subsampling formats may be 
employed. However if subsampling is performed by simply 
dropping pixel values, then the subsampling factors are limited to 
powers of two. Alternatively if subsampling is performed by 

2 0 interpolation, a wide selection of decimation factors may be 

accommodated. 

Since the data has been reduced by a factor of 4, the 
buffer or VRAM memory capacity is reduced by a factor of 4 
relative to the FIGURE 3 apparatus. The VRAM 315 shown in 

2 5 FIGURE 4 will generally be of the form of the memory elements 

314 and 316 shown in FIGURE 3. Note however that even in 
FIGURE 3 the two memory section 314 and 316 may be realized 
by a single memory element or a multiplicity of memory 
elements. 

3 0 The speed requirements of the circuitry following the 

decimator 311 is similarly reduced. The predictor 304' differs 
from the predictor 304 in FIGURE 3 in that, responsive to the 
motion vectors, it accesses e.g., 4 by 4 matrices of pixel values 
from memory rather than 8 by 8 matrices. A further difference 
3 5 resides in the addressing structure. Nominally the predictor 
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generates addresses, or at least a starting addresses for accessing 
matrices of pixels identified by the motion vectors. The reduced 
size VRAM will not have address locations ( and thus addresses) 
5 corresponding to all possible addresses represented by the motion 
vectors. This may be accommodated however, by generating 
addresses in the predictor as for the larger memory structure, but 
using only the more significant bits of the generated addresses. 
For the case where the data is decimated by a factor of two in 
1 0 both the horizontal and vertical directions, this entails applying all 
but the least significant bit of the vertical and horizontal address 
values to the VRAM address busses. Alternatively the motion 
vectors may be truncated before being applied to the predictor as 
indicated by the truncation element 307. 

1 5 FIGURE 5 illustrates a further embodiment which 

produces improved images over the FIGURE 4 embodiment. The 
improvement results because advantage is taken of the total 
motion vectors not truncated motion vectors or the affects of 
truncating memory addresses to the VRAM 315. In FIGURE 5 an 
20 interpolator 319 is interposed between the. VRAM 315 and the 
predictor 304. In addition a two dimensional decimator 313, 
similar to decimator 311, is interposed between the predictor 304 
and the adder 312. The interpolator 319 accepts blocks of data 
from the VRAM 315 and generates 8 by 8 blocks which are 

2 5 coupled to the predictor. The predictor couples the 8 by 8 blocks 

of data to the decimator 313 which subsamples the data back 
down to 4 by 4 blocks of data in conformance with the data 
format applied to the adder from decimator 311. 

To understand how this process improves image 

3 0 reconstruction accuracy refer to FIGURES 5 and 6. FIGURE 6 

represents the algorithm performed by the interpolator 319. For 
this exemplary algorithm it is assumed that 5 by 5 blocks of data 
are accessed from the VRAM 315 rather than 4 by 4 blocks. The 
4 by 4 block of data that a truncated address would access is 
3 5 included in the upper left hand corner of the 5 by 5 block that is 
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accessed from the VRAM. The 5 by 5 block of data accessed from 
memory is represented in FIGURE 6 by the open circles. The black 
diamonds represent interpolated values. The interpolated values 
5 may be generated by any of the known two dimensional 

interpolation techniques. For example the interpolated values in 
the even numbered rows RO, R2, R4, R6 and R8, may be generated 
by averaging the two values between which the interpolated 
values are disposed. The interpolated values in the odd 

10 numbered rows may be generated by averaging the values above 
and below the respective interpolated values. The matrix of 
values shown in FIGURE 6 is comprised of 9 rows and 9 columns. 
The interpolator provides a matrix of 8 rows and 8 columns to the 
predictor 304. Hence, there is possibility of a choice of data. In 

15 this example the choice is determined by the least significant bit, 
LSB, of the starting point address generated by the predictor for 
accessing the block of data from the VRAM 315. If the LSB of the 
vertical address is even or logical zero, the matrix output by the 
interpolator includes rows R0-R7. If the LSB of the vertical 

2 0 address is odd or logical one, the matrix output includes rows Rl- 

R8. Similarly, if the LSB of the horizontal or column addressed is 
even (odd) the matrix output includes columns C0-C7 (C1-C8). In 
the decimated domain the choice of alternate matrices, which are 
relatively displaced by a row and/or column, provides a half pixel 

25 improvement (with respect to subsampled images) in the accuracy 
of the reconstructed reduced resolution image. 

Alternative interpolator apparatus may be utilized for 
element 319, which apparatus will determine the size (e.g., 4X4, 
5X5, 6X6) of the matrices accessed from the VRAM 315. 

3 0 The FIGURE 5 embodiment has the advantages of 

reduced memory, slightly enhanced resolution and lessened 
computational speed requirements for the circuit elements 
following the decimator 311. 

Figure 7 illustrates a further embodiment, which is 

3 5 similar to the FIGURE 5 embodiment, in that it provides the half 
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pixel resolution enhancement. The FIGURE 7 apparatus has the 
decimator 311 moved to the connection between the output of the 
adder 312 and the input to the VRAM's. This eliminates the 
5 necessity for a decimator between the predictor 304 and the 

adder 312, and thus is somewhat less hardware intensive than the 
FIGURE 5 apparatus. However in this embodiment the adder is 
required to perform 8 times 8 or 64 additions per block as 
opposed to 4 times 4 or 16 additions per block. The remainder of 

1 0 the circuitry operates in the same manner as the corresponding 
circuitry in FIGURE 5. 

A variation on the FIGURE 7 circuitry may be realized 
by connecting the VRAM 315 directly to the predictor 304" and 
interposing the interpolator 319 between the predictor 304" and 

15 the adder 312. 

FIGURE 8 illustrates a preferred embodiment, which 
not only realizes a reduction in the size of the VRAM's, but also a 
reduction in the complexity of the IDCT 320. In the FIGURE 8 
apparatus, decimation of the pixel matrices is performed directly 

2 0 in the IDCT 320. That is, the IDCT provides decimated blocks of 

pixel values to the adder 312, and as a result the remainder of the 
circuit is arranged and operates similar to the FIGURE 5 apparatus. 
Data provided to the IDCT 320 are a sequence of coefficients 
representing the spatial frequency spectra of image areas 

2 5 represented by matrices of 8 by 8 pixels. In this example the 

respective frequency sprectra for respective image areas are 
represented by up to 64 coefficients, depending upon the image 
content. If the number of coefficients provided to the IDCT are 
lessened, the spatial resolution of the image areas represented by 

3 0 the pixel matrices output by the IDCT is concomitantly lessened. 

Because the spatial resolution is reduced the image areas can be 
represented with a fewer number of pixels without further 
affecting the image quality. If the image area can be represented 
with fewer pixels, the IDCT can be arranged to calculate fewer 
3 5 output values. 
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Assuming that the system of FIGURE 8 is to provide 
images corresponding to a decimation, by a factor of two in both 
the vertical and horizontal directions, of the transmitted 
5 information, the IDCT 320 is arranged to calculate 4 by 4 matrices 
of output values from the 8 by 8 matrices of input coefficients. 
This translates into a significant hardware savings in the IDCT as 
well as lowering the requisite speed of operation of the IDCT. The 
IDCT 320 is supplied with 4 by 4 matrices of coefficients selected 

10 from the 8 by 8 matrices of transmitted coefficients. This 

selection of 4 by 4 matrices of coefficients is accomplished by the 
coefficient masking apparatus 308 shown in FIGURE 8. The 
element 308 is illustrated as a box with a matrix of 8 by 8 dots. 
Each of the dots represents a coefficient. The shaded portion of 

1 5 dots is meant to indicate the coefficients which are discarded or 
not applied to the IDCT. The importance of each of the coefficients 
to image reconstruction is known a priori. Hence the designer is 
free to select those coefficients for processing which he believes 
will be most beneficial to image reproduction. In the nominal 

20 MPEG signal format, the coefficients occur in ascending order of 
frequency spectra, and with respect to the matrix illustrated, 
occur in a zig-zag arrangement. Therefore, in the simplest case, 
one need only select the first 16 coefficients transmitted for each 
image area. 

25 Decimation in the FIGURE 8 apparatus is effectively 

performed in the frequency domain, hence antialias filters are not 
required in the processing chain, except as may be desired in the 
decimator 313. 

The masking function may be performed in the 

3 0 decompression controller 302 (FIGURE 3), as indicated by the 
added element 301 in FIGURE 9. Note, element 301 may be a 
distinct hardware apparatus, or its function may be programmed 
in the controller 302. The masking process is illustrated by the 
flow chart in FIGURE 10. 

35 
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The masking function is one of monitoring available 
data and selecting a predetermined portion of it. Assuming the 
data to be in MPEG format, it is layered as indicated in FIGURE 1. 
5 This data includes header data down to the block level. All of the 
header data is required by the decompression controller, and thus 
element 301 is conditioned to pass all header data. At the block 
level the data comprises DCT coefficients or EOB codes. Depending 
on the image content, each block may contain from one to 64 
1 0 coefficients, with the last non-zero coefficient followed by an EOB 
code. If a block includes more than 16 coefficients, the apparatus 
301 will pass the first 16 coefficients, then an EOB code, and 
discard the following coefficients included in the block. The end 
of the block is recognized at the occurrence of the original EOB 

1 5 code. At this point data for the next successive block commences, 

and the first 16 coefficients are selected etc. 

Referring to FIGURE 10, data from the decoder 300 is 
acquired (80) and examined (81). If the data is header data, it is 
passed on to the controller 302 and a count (84) is reset to zero. 
20 If the data is not header data, it is examined (83) to determine if 
it is coefficient data. If is not coefficient clata (e.g. it may be 
motion vector data etc.) it is passed to the controller 302. If it is 
coefficient data, a count value is incremented (84). The count 
value is examined and the data is examined (85) to determine if it 

2 5 is an EOB code. If the count value is greater than N (in this 

example N=16) , the data is discarded (86) until an EOB occurs 
which also is discarded,because it is excess data. If the count 
value is less than N the data is examined (88) to determine 
whether it is an EOB. If it is not an EOB it is passed (87) to the 

3 0 controller an the next dataword is examioned(81). If it is an EOB, 

indicating that the all the remaining coefficients in the block are 
zero valued, the EOB is passed to the controller 302 and the count 
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is reset to zero (89) in preparation for the start of data for the 
next successive block of data. If at step 85 the count value is 
equal to N, the dataword causing the count to increment to N is 
5 replaced with an EOB. 

FIGURES 8A, 8B and 8C show possible alternative 
masking functions for the coefficient data. The masking function 
of FIGURE 8C will result in the spatial frequency response in the 
vertical and horizontal dimensions being different. Such a 

1 0 masking function may be employed in the instance where, for 
example, a 4 by 3 image is to be converted to a 16 by 9 image. 

The foregoing description has used a decimation factor 
of 2 in the horizontal and vertical dimensions, however the 
invention is not limited to factors of two. In general any 

1 5 decimation factor from one to eight may be used, though the two 
extremes are of little utility. 
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CLAIMS: 

1. Apparatus for decompressing compressed video 
data occurring in blocks representing respective image areas of 
5 successive frames with a first spatial resolution, and wherein each 
frame consists of a plurality of distinct image areas, said 
apparatus including memory means (315) for storing 
decompressed video data, means (310,31 1,304';320,304") for 
decompressing respective blocks of data to produce decompressed 
1 0 video signal representing corresponding image areas with a 

second spatial resolution lower than said first spatial resolution, 
and means for providing said decompressed video signal to said 
memory means. 

15 2. The apparatus set forth in claim 1 wherein said 

compressed video signal occurs in blocks of codewords 
representing M by M pixels, and said decompression means 
produces blocks of N by N pixels representing said image areas, 
where M and N are integers with M greater than N. 

20 

3. The apparatus set forth in claim 1 wherein said 
blocks of compressed video data consist of coefficients generated 
by performing a transform over M by M matrices of pixel values, 
and said means (320) for decompressing includes inverse 

25 transform means for performing inverse transforms over N by N 
matrices of transform coefficients, and means (308), responsive to 
said coefficients generated by performing a transform over M by 
M matrices of pixel values, for providing N by N matrices of 
coefficients to said means for performing inverse transforms for 

3 0 respective image areas, where M and N are integers and M is 
greater than N. . 
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4. The apparatus set forth in claim 1 wherein said 
blocks of compressed video data consist of coefficients generated 
by performing a discrete cosine transform over M by M matrices 
5 of pixel values, and said means for decompressing includes 
inverse discrete cosine transform means (320) for performing 
inverse discrete cosine transforms over N by N matrices of 
discrete cosine transform coefficients, and means (308) responsive 
to said coefficients generated by performing a discrete cosine 

1 0 transform over M by M matrices of pixel values for providing N 

by N matrices of coefficients to said means for performing inverse 
discrete cosine transforms for respective image areas, where M 
and N are integers and M is greater than N. 

15 5. The apparatus set forth in claim 3 wherein said 

apparatus further includes: 

summing means (312), having a first input terminal 
coupled to said inverse transform means, having a second input 
terminal, and having an output terminal coupled to said memory 

2 0 means (315); and 

a video signal motion compensated predictor (304') 
coupled between said memory means and said second input of 
said summing means. 
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6. The apparatus set forth in claim 5 further 

including; 

interpolation means (319) coupled between said 
5 memory means and said video signal motion compensated 

predictor, for generating M by M matrices of pixel values from N 
by N matrices of pixel values accessed from said memory means; 
and 

a decimator (313) coupled between said video signal 
10 motion compensated predictor and the second input terminal of 
said summing means, for generating N by N matrices of pixel 
values from M by M matrices of pixel values provided from said 
video signal motion compensated predictor. 

1 5 7. The apparatus set forth in claim 6 wherein said 

compressed video data includes motion vectors which are coupled 
to said video signal motion compensated predictor (304') for 
conditioning said video signal motion compensated predictor to 
generate memory read addresses for accessing respective 

2 0 matrices of pixel values, and a least significant bit of said memory 

read addresses is coupled to control said interpolation means. 

8. The apparatus set forth in claim 1 wherein said 
means for decompressing respective blocks of data includes; 

25 a first decimator (311) having an input terminal for 

receiving said blocks of compressed video signal and having an 
output terminal, said first decimator for providing N by N 
matrices of compressed video signal values from M by M matrices 
of compressed video signal values. 

30 summing means (312), having a first input terminal 

coupled to the output terminal of said first decimator, having a 
second input terminal, and having an output terminal coupled to 
said memory means; 

interpolation means (319) having an input terminal 

3 5 coupled to said memory means and having an output terminal, 
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for generating M by M matrices of pixel values from N by N 
matrices of pixel values accessed from said memory means; 

a video signal motion (304") compensated predictor 
5 having an input terminal coupled to the output terminal of said 
interpolation means, and having an output terminal; and 

a second decimator (313) coupled between said video 
signal motion compensated predictor and the second input 
terminal of said summing means, for generating N by N matrices 
10 of pixel values from M by M matrices of pixel values provided 
from said video signal motion compensated predictor. 

9. The apparatus set forth in claim 8 wherein said 
compressed video data includes motion vectors which are coupled 

15 to said video signal motion compensated predictor (304") for 
conditioning said video signal motion compensated predictor to 
generate memory read addresses for accessing respective 
matrices of pixel values, and a least significant bit of said memory 
read addresses is coupled to control said interpolation means 

20 

10. The apparatus set forth in claim 1 wherein said 
means for decompressing respective blocks of data includes ; 

summing means (312), having a first input terminal 
coupled for receiving said blocks of compressed video signal, 

2 5 having a second input terminal, and having an output terminal; 

a decimator(311) having an input terminal coupled to 
the output terminal of said summing means and having an output 
terminal coupled to an input terminal of said memory means, said 
decimator for providing N by N matrices of values from M by M 

3 0 matrices of values provided from said summing means; 

interpolation means (319) having an input 
terminal coupled to said memory means and having an output 
terminal, for generating M by M matrices of pixel values from N 
by N matrices of pixel values accessed from said memory means; 
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a video signal motion compensated predictor (304") 
having an input terminal coupled to the output terminal of said 
interpolation means, and having an output terminal to the second 
5 input terminal of said summing means. 

11. The apparatus set forth in claim 10 wherein said 
compressed video data includes motion vectors which are coupled 
to said video signal motion compensated predictor (304") for 

1 0 conditioning said video signal motion compensated predictor to 
generate memory read addresses for accessing respective 
matrices of pixel values, and a least significant bit of said memory 
read addresses is coupled to control said interpolation means. 

15 

12. The apparatus set forth in claim 1 wherein said 
means for decompressing respective blocks of data includes ; 

summing means (312), having a first input terminal 
coupled for receiving said blocks of compressed video signal, 
20 having a second input terminal, and having an output terminal; 

a decimator (311) having an input terminal coupled to 
the output terminal of said summing means and having an output 
terminal coupled to an input terminal of said memory means, said 
decimator for providing N by N matrices of values from M by M 

2 5 matrices of values provided from said summing means; 

a video signal motion compensated predictor (304") 
having an input terminal coupled to said memory means, and 
having an output terminal; and 

interpolation means (319) having an input terminal 

3 0 coupled to the output terminal of said video signal motion 

compensated predictor and having an output terminal coupled to 
the second input terminal of said summing means, for generating 
M by M matrices of pixel values from N by N matrices of pixel 
values provided by said video signal motion compensated 
3 5 predictor. 
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13. The apparatus set forth in claim 12 wherein said 
compressed video data includes motion vectors which are coupled 
to said video signal motion compensated predictor for conditioning 
5 said video signal motion compensated predictor to generate 

memory read addresses for accessing respective matrices of pixel 
values, and a least significant bit of said memory read addresses 
is coupled to control said interpolation means. 

10 



931 7523 A1> 



WO 93/17523 



PCT/US93/00071 



1/6 



I G0F1 


GOF2 | 


GOF3 I 


GOF4 I 


GOF5 j 




1 4 

LI 


















G-HEADER 


PI P2 | 


P3 P4 


P5 




Pn 


\ 


L2 


> 


\ 




P-HEADER 


GOBI GOB2 


GOB3 GOB4 


G0B5 




GOBn 


L3 
















S-HEADER 


MB1 MB2 


MB3 MB4 


MB5 




MBr 


\ 


L4 




V 














M-HEADER 


MV BD 












L5 



DC1 AC11 AC12 



AC1j 



: i 



AC1L EOB1 



► DC2 


AC21 


AC22 


AC2j 




I AC2L 


E0B2 




► DC6 


AC61 


AC62 


AC6j | 




AC6L 


E0B6 



D 

D L6 



FIG. 1 



TUNER 
DEMOD 



0 



11 



FEC 
RESHUFFLE 



12 



I> DEPACKET 



15 



IMAGE 
MEMORY 



O / 

DISPLAY/ 
RECORD 



16 



13 



1 



DECOMPRESS 



FIG. 2 



-IN- 
VARIABLE 
LENGTH 
DECODE 



9317523A1> 



WO 93/17523 



PCI7US93/00071 



2/6 



FIG. 3 



306A 




IDPCM 



VIDEO 
DATA 



VARIABLE 
LENGTH 
DECODER 


_^300 

CBC= 


SYSTEM 
CONTROLLER 


--USER 
s — INPUT 









FIG. 4 



COEFF 



310 



INVERSE 
DCT 



311 

DEC f ^V V 



VIDEO OUT 



312 




304' 



MOTION 
VECTORS 



VIDEO-DISPLAY 
RAM 



318 



7/ 



MSB's 
315 



MC 
PREDICTOR 




i ^-W-i 

ADD 

VRAM 





9317523A1> 



WO 93/17523 



PCT/US93/00071 



3/6 



310 



311 



COEFF 



312 



VIDEO OUT 



INVERSE 




2D 


DCT 




DEC 




FIG. 5 




MOTION 
VECTORS 



CO C1 C2 C3 C4 C5 C6 C7 C8 

O ♦ O ♦ . O ♦ ■ O ♦ O 

R1 + + + + + + + + + 

R 2 O ♦ O ♦ O ♦ O ♦ O 

R3 + + + + + + + + + 

R4 o ♦ o ♦ o ♦ o ♦ o 



R5 



R6 0 ♦ o ♦ o ♦ o ♦ o 
R7 ♦ ♦♦♦♦♦♦♦ ♦ 

FIG. 6 



9317523A1> 



WO 93/17523 



PCI7US93/00071 



4/6 



COEFF 



FIG. 7 




304" 

MOTION ^ 
VECTORS 



MC 
PREDICTOR 




COEFF 




304" 

MOTION ^ 
VECTORS 



FIG. 8 



9317523A1> 



WO 93/17523 



PCT/US93/00071 



5/6 



MASKED 
DATA OUT 




308' 



FIG. 8 A 



MASKED 
DATA OUT 




' COEFF 



FIG. 8B 



MASKED 
DATA OUT 



i 




FIG. 8C 



COEFF 



306A 



IDPCM 



MV's 



LI 



302 



IDPCM | 



306B 
1 



DECOMP 
/| CONTROL 



VIDEO 
DATA 



SELECT 
DATA 



I 



VARIABLE 
LENGTH 
DECODER 



CB 
301 

300 



FIG. 9 



931 7523 A1> 



WO 93/17523 



i 

PCT/US93/00071 



6/6 




BNSDOCID: <W0 931 7523A1 > 



INTERNATIONAL SEARCH REPORT 



i...ernational application No. 

PCT/US 93/00071 



A. CLASSIFICATION OF SUBJECT MATTER 



IPC5: H04N 7/01, H04N 7/12, H04N 5/44 

According 10 International Paunl Classification (IPC) or 10 bo 



• both national classification and IPC 



B. FIELDS SEARCHED 



Minimum documentation searched (classification system followed by classification symbols) 

IPCS: H04N 



Documentation searched other than minimum documentation lo the extent that such documents are included in the fields searched 



Electronic data base consulted during the international search (name of data base and, where practicable, search terms used) 



WPIL, CLAIMS 



C. DOCUMENTS CONSIDERED TO BE RELEVANT 



Category* 



Citation of document, with indication, where appropriate, of the relevant passages 



i^itauon oi aocumeni, wiui matcauon, wnere appro 

WO, Al, 8603921 (RCA CORPORATION), 
(03.07.86), page 12, line 34 - 
page 25, line 32 - page 27, 11 



Relevant Lo claim No. 



jrvrurirt i jlww j , 3 July 1986 
!, line 34 - page 14, line 19; 
le 32 - page 27, line 4, figures 3,5 



1-13 



EP, A2, 0460928 (MATSUSHITA ELECTRIC INDUSTRIAL 
CO), 11 December 1991 (11.12.91), page 4, 
line 7 - line 56, figure 1 



US, A, 5049993 (DIDIER J. LEGALL ET AL) , 
17 Sept 1991 (17.09.91), abstract 



Further documents are listed in the continuation of Box C. 



See patent family annex. 



* Special ca leg ones of cited documents: 

* A* document defining the general state of the art which is not considered 

to be of particular relevance 
'E* erlier document but published on or after the international filing date 

"L" document which may throw doubts on priority clatm(s) or which is 
cited to establish the publication date of another citation or other 
special reason (as specified) 

"O* document referring to an oral disclosure* use, exhibition or other 
means 

* P" document published prior to the international filing date but later than 

the priority date claimed * 



later document published after the international filing date or priority 
date and not in conflict with the application bur cited to understand 
the principle or theory underlying the invention 

document of particular relevance: the claimed invention cannot be 
considered novel or cannot be considered to involve an inventive 
step when the document is taken alone 

document of particular relevance: the claimed invention cannot be 
considered to involve an inventive step when the document is 
combined with one or more other such documents, such combination 
being obvious to a person skilled in the art 

document member of the same patent family 



Date of the actual completion of the international search 



24 Mav 1993 



Dale of mailing of the international search report 

0 7. 06. 93 



N ame and maiiine address ot ihc ISA/ 

Jcurooean Patent OfTicx, P. 3. 581$ Paientlsan 2 
HV Rnswijic 
Tel. (-^31.70) 3*0-1040, Tx. 2\ 651 eoa ni, 
. rue: (t-31-70) J40-3016 



Authorized officer 



Bertil Ljungdahl 



Form PCT/ISA/210 (second sheet) (July 1992) 



BNSDOCID: <WO 9317S23A1> 



2 







INTERNATIONAL SEARCH REPORT 


International application No. 
PCT/US 93/00071 


* 


C (Continuation). DOCUMENTS CONSIDERED TO BE RELEVANT 




Category* 


CiLation of document, with indication, where appropriate, of the relevant passages 


Relevant to claim No. 




A 


US, A, 4991010 (KEITH R. HA I LEY ET AL) , 
5 February 1991 (05.02.91), column 2, 
line 58 - column 4, line 20, figure 2, 
abstract 




i 




P.A 


US, A, 5122875 (DIPANKAR RAYCHAUDHURI ET AL), 
16 June 1992 (16.06.92), column 18, 
line 50 - column 19, line 68, figure 10 


* 


1-13 



Form.PCr/ISA/210 (continuation of second sheet) (July 1992) 



BNSDOCID: <WO 9317523A1> 



SA 3895 



INTERNATIONAL SEARCH REPORT 

Information on patent family members 

31/03/93 


International application No. 
PCT/US 93/00071 


Patent document 
cited in search report 


Publication 
date 


Patent family 
member(s) 


Publication 
date 


W0-A1- 8603921 


03/07/86 


CA-A- 1236914 


17/05/88 



EP-A,B- 0205554 30/12/86 
JP-T- 61502859 04/12/86 
US-A- 4603350 29/07/86 



EP-A2- 0460928 11/12/91 JP-A- 4040787 12/02/92 

US-A- 5168358 01/12/92 
JP-A- 4196788 16/07/92 



US-A- 5049993 17/09/91 NONE 



US-A- 


4991010 


05/02/91 


AU-B- 
AU-A- 
EP-A- 
JP-T- 
W0-A- 


634605 
6735290 
0453558 
4503141 
9107848 


25/02/93 
13/06/91 
30/10/91 
04/06/92 
30/05/91 


US-A- 


5122875 


16/06/92 


AU-A- 
W0-A- 


1330992 
9216071 


06/10/92 
17/09/92 



Form PCT/ISA/210 (patent family annex) (July 1992) 



<WO 9317523A1> 



This Page is Inserted by IFW Indexing and Scanning 
Operations and is not part of the Official Record 

BEST AVAILABLE IMAGES 

Defective images within this document are accurate representations of the original 
documents submitted by the applicant. 

Defects in the images include but are not limited to the items checked: 

□ BLACK BORDERS 

□ IMAGE CUT OFF AT TOP, BOTTOM OR SIDES 

□ FADED TEXT OR DRAWING 
BLURRED OR ILLEGIBLE TEXT OR DRAWING 

□ SKEWED/SLANTED IMAGES 

□ COLOR OR BLACK AND WHITE PHOTOGRAPHS 

□ GRAY SCALE DOCUMENTS 

□ LINES OR MARKS ON ORIGINAL DOCUMENT 

□ REFERENCE(S) OR EXHIBIT(S) SUBMITTED ARE POOR QUALITY 

□ OTHER: 

IMAGES ARE BEST AVAILABLE COPY. 
As rescanning these documents will not correct the image 
problems checked, please do not report these problems to 
the IFW Image Problem Mailbox. 



